Triple Helixes, Classification Schemes and the Knowledge Ecologies of Innovation

This paper suggests that a major challenge for the future is to make progress on frameworks that can incorporate the concept of knowledge ecologies as approach for organising data. It aims to clarify the nature of the problem and suggests a number of approaches that could move us towards improving the usefulness of science, technology, and research and development data

Quality of life returns from basic research

<p>Abstract</p> <p>Background</p> <p>Assessing the consequences of research is an increasingly important task in research and innovation policy. This paper takes a broader view of those consequences than the conventional economic approach, placing researchers and their activities in the centre of the assessment process and examining results for professional practice and general education as well as contributions to knowledge.</p> <p>Methods</p> <p>The paper uses historical and documentary analysis to illustrate the approach, focusing on U.S. biomedicine over the past century. At aggregate level, the analysis attributes portions of the change in aggregate health indicators to research and research-based institutions, through several available types of logic: either through correlations between timing of institutional changes and changes in the indicators or through direct or indirect causal connections.</p> <p>Results</p> <p>The analysis shows that while biomedical research has certainly contributed to improved health in the United States, other factors have also contributed. In some ways the institutional structure of science-based medicine has worked against creating benefits for some groups in U.S. society.</p> <p>Conclusions</p> <p>The paper concludes with a call for more strategic attention to dimensions of impact other than knowledge outcomes and for participatory planning for research.</p

Research Output From University-Industry Collaborative Projects

We study collaborative and noncollaborative projects that are supported by government grants. First, we propose a theoretical framework to analyze optimal decisions in these projects. Second, we test our hypotheses with a unique data set containing academic publications and research funds for all academics at the major university engineering departments in the United Kingdom. We find that the type of the project (measured by its level of appliedness) increases the type of both the university and firm partners. Also, the quality of the project (number and impact of the publications) increases with the quality of the researcher and firm, and with the affinity in the partners' preferences. The collaboration with firms increases the quality of the project only when the firms' characteristics make them valuable partners

The impact of Cochrane Systematic Reviews : a mixed method evaluation of outputs from Cochrane Review Groups supported by the UK National Institute for Health Research

© 2014 Bunn et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.Background: There has been a growing emphasis on evidence-informed decision making in health care. Systematic reviews, such as those produced by the Cochrane Collaboration, have been a key component of this movement. The UK National Institute for Health Research (NIHR) Systematic Review Programme currently supports 20 Cochrane Review Groups (CRGs). The aim of this study was to identify the impacts of Cochrane reviews published by NIHR funded CRGs during the years 2007-11. Methods: We sent questionnaires to CRGs and review authors, interviewed guideline developers and used bibliometrics and documentary review to get an overview of CRG impact and to evaluate the impact of a sample of 60 Cochrane reviews. We used a framework with four categories (knowledge production, research targeting, informing policy development, and impact on practice/services). Results: A total of 1502 new and updated reviews were produced by the 20 NIHR funded CRGs between 2007-11. The clearest impacts were on policy with a total of 483 systematic reviews cited in 247 sets of guidance; 62 were international, 175 national (87 from the UK) and 10 local. Review authors and CRGs provided some examples of impact on practice or services, for example safer use of medication, the identification of new effective drugs or treatments and potential economic benefits through the reduction in the use of unproven or unnecessary procedures. However, such impacts are difficult to objectively document and the majority of reviewers were unsure if their review had produced specific impacts. Qualitative data suggested that Cochrane reviews often play an instrumental role in informing guidance although a poor fit with guideline scope or methods, reviews being out of date and a lack of communication between CRGs and guideline developers were barriers to their use. Conclusions: Health and economic impacts of research are generally difficult to measure. We found that to be the case with this evaluation. Impacts on knowledge production and clinical guidance were easier to identify and substantiate than those on clinical practice. Questions remain about how we define and measure impact and more work is needed to develop suitable methods for impact analysis.Peer reviewe

The utilisation of health research in policy-making: Concepts, examples and methods of assessment

The importance of health research utilisation in policy-making, and of understanding the mechanisms involved, is increasingly recognised. Recent reports calling for more resources to improve health in developing countries, and global pressures for accountability, draw greater attention to research-informed policy-making. Key utilisation issues have been described for at least twenty years, but the growing focus on health research systems creates additional dimensions. The utilisation of health research in policy-making should contribute to policies that may eventually lead to desired outcomes, including health gains. In this article, exploration of these issues is combined with a review of various forms of policy-making. When this is linked to analysis of different types of health research, it assists in building a comprehensive account of the diverse meanings of research utilisation. Previous studies report methods and conceptual frameworks that have been applied, if with varying degrees of success, to record utilisation in policy-making. These studies reveal various examples of research impact within a general picture of underutilisation. Factors potentially enhancing utilisation can be identified by exploration of: priority setting; activities of the health research system at the interface between research and policy-making; and the role of the recipients, or 'receptors', of health research. An interfaces and receptors model provides a framework for analysis. Recommendations about possible methods for assessing health research utilisation follow identification of the purposes of such assessments. Our conclusion is that research utilisation can be better understood, and enhanced, by developing assessment methods informed by conceptual analysis and review of previous studies

The Calculus of Committee Composition

Modern institutions face the recurring dilemma of designing accurate evaluation procedures in settings as diverse as academic selection committees, social policies, elections, and figure skating competitions. In particular, it is essential to determine both the number of evaluators and the method for combining their judgments. Previous work has focused on the latter issue, uncovering paradoxes that underscore the inherent difficulties. Yet the number of judges is an important consideration that is intimately connected with the methodology and the success of the evaluation. We address the question of the number of judges through a cost analysis that incorporates the accuracy of the evaluation method, the cost per judge, and the cost of an error in decision. We associate the optimal number of judges with the lowest cost and determine the optimal number of judges in several different scenarios. Through analytical and numerical studies, we show how the optimal number depends on the evaluation rule, the accuracy of the judges, the (cost per judge)/(cost per error) ratio. Paradoxically, we find that for a panel of judges of equal accuracy, the optimal panel size may be greater for judges with higher accuracy than for judges with lower accuracy. The development of any evaluation procedure requires knowledge about the accuracy of evaluation methods, the costs of judges, and the costs of errors. By determining the optimal number of judges, we highlight important connections between these quantities and uncover a paradox that we show to be a general feature of evaluation procedures. Ultimately, our work provides policy-makers with a simple and novel method to optimize evaluation procedures

Bibliometric Evidence for a Hierarchy of the Sciences

The hypothesis of a Hierarchy of the Sciences, first formulated in the 19(th) century, predicts that, moving from simple and general phenomena (e.g. particle dynamics) to complex and particular (e.g. human behaviour), researchers lose ability to reach theoretical and methodological consensus. This hypothesis places each field of research along a continuum of complexity and "softness", with profound implications for our understanding of scientific knowledge. Today, however, the idea is still unproven and philosophically overlooked, too often confused with simplistic dichotomies that contrast natural and social sciences, or science and the humanities. Empirical tests of the hypothesis have usually compared few fields and this, combined with other limitations, makes their results contradictory and inconclusive. We verified whether discipline characteristics reflect a hierarchy, a dichotomy or neither, by sampling nearly 29,000 papers published contemporaneously in 12 disciplines and measuring a set of parameters hypothesised to reflect theoretical and methodological consensus. The biological sciences had in most cases intermediate values between the physical and the social, with bio-molecular disciplines appearing harder than zoology, botany or ecology. In multivariable analyses, most of these parameters were independent predictors of the hierarchy, even when mathematics and the humanities were included. These results support a "gradualist" view of scientific knowledge, suggesting that the Hierarchy of the Sciences provides the best rational framework to understand disciplines' diversity. A deeper grasp of the relationship between subject matter's complexity and consensus could have profound implications for how we interpret, publish, popularize and administer scientific research

How interdisciplinary is nanotechnology?

Facilitating cross-disciplinary research has attracted much attention in recent years, with special concerns in nanoscience and nanotechnology. Although policy discourse has emphasized that nanotechnology is substantively integrative, some analysts have countered that it is really a loose amalgam of relatively traditional pockets of physics, chemistry, and other disciplines that interrelate only weakly. We are developing empirical measures to gauge and visualize the extent and nature of interdisciplinary interchange. Such results speak to research organization, funding, and mechanisms to bolster knowledge transfer. In this study, we address the nature of cross-disciplinary linkages using “science overlay maps” of articles, and their references, that have been categorized into subject categories. We find signs that the rate of increase in nano research is slowing, and that its composition is changing (for one, increasing chemistry-related activity). Our results suggest that nanotechnology research encompasses multiple disciplines that draw knowledge from disciplinarily diverse knowledge sources. Nano research is highly, and increasingly, integrative—but so is much of science these days. Tabulating and mapping nano research activity show a dominant core in materials sciences, broadly defined. Additional analyses and maps show that nano research draws extensively upon knowledge presented in other areas; it is not constricted within narrow silos